DEMOGRAPHIC DATA DEVELOPMENT AND PROCESSING 

Field of the Invention 
The present invention generally relates to demographic data development and 
analysis systems, and more particularly, to methods and apparatus for collecting, 
5 assembling, analyzing and/or displaying demographic or other data. 

Background of the Invention 
Demographic data is used extensively by both industry and government for a wide 
variety of applications, including decision support and planning. The primary source of 
residential demographic data is the U.S. Census Bureau, which publishes a 
10 comprehensive survey of resident characteristics every ten years. One limitation of the 
U.S. Census is that demographic changes that occur between census reporting years are 
not represented. As a result, much of the demographic data that is available between 
census takings is based on projections or extrapolations from the previous U.S. Census. 
This can result in significant errors in the data, especially in the later years between 
15 census reports. 

The U.S. Census has other limitations as well For many organizations, faced 
with local or project related decisions, the level of detail needed to support many 
decisions is simply not available from the U.S. Census. For example, the U.S. Census 
may not track housing conditions, neighborhood turnover, access to transportation, work 

20 force needs, or other demographics that are deemed important to a particular decision or 
plan. Even if a particular demographic variable is available, the data may not correspond 
to the desired geographic region. The U.S. Census provides summary data based on 
relatively large fixed geographic regions, which may not correspond to a desired project 
or program region, such as a corridor along a major highway, a school district, or a 

25 neighborhood. Accordingly, U.S. census data is often not used, or not used effectively, in 
making local, neighborhood, program, or project level decisions. 

As an alternative to the U.S. Census, some communities and organizations have 
undertaken local surveys to gather additional or more current data for their decision- 
making needs. Many of these organizations have found local surveys to be cost 

30 prohibitive where decision-making needs are at a neighborhood or site planning area. 



-1- 



fetsF 



Questions also arise regarding the accuracy or truthfulness of the survey results and the 
degree to which the survey respondents are representative of the population at large. 

Summary of the Invention 
The present invention relates to systems and methods for producing timely and 
5 accurate demographic data that can be particularly helpful for local, neighborhood, 
program or project level decisions. In a preferred embodiment, this result is 
accomplished by means of a process that merges and distills demographic characteristics 
from multiple state, local or other administrative databases and then cross-checks the 
fundamental household counts by matching addresses to detailed digital property and 

10 land use maps, or associated ownership data. 

Each of the source databases are selected to provide at least some resident 
attribute data that is different from the data provided by other source databases. 
Matching data is also sought as a means to cross-validate the information received. The 
source database pool may include, for example, a postal service database that identifies 

15 street addresses for residential properties in the predefined geographic region. Drivers 
license data might be added to identify resident names, ages, gender and help determine 
occupancy dates. Property tax data might be used to identify street addresses, owner 
names, type of dwelling, property values, and owner/renter status. Motor vehicle 
registration data would be used as another crosscheck of resident names and occupancy 

20 dates while also providing new information on vehicle ownership. Utility billing data 
generally provides a reliable set of addresses and identifies move-in or move-out dates. 
School census data helps fill in information regarding children, ethnicity, language 
spoken and length of time at current address. 

Many of these illustrative source databases are regularly updated by an agency or 

25 organization responsible for maintaining the database, and may provide relatively up-to- 
date information. No single agency database is sufficiently accurate or complete for 
demographic profiling purposes. In combination, using the methods and processes 
associated with this invention, these databases become a significant resource for 
producing current and accurate demographic profiles. 

30 The resident attribute data from each of the source databases is linked together by 

a corresponding street address and/or property identifier within a predefined geographic 
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region. Once associated, records from of the source databases are combined into a new 
resident-specific dataset grouped by common address. Each address and each current and 
former resident of an address may be represented by records from many source databases, 
A processing routine selects and tags pertinent records for each address from the 
5 combined dataset and produces a tentative demographic profile for each street address, 
household, parcel of land or other identifier. For example, the number of people, 
including children, living at a particular street address, household, or parcel of land may 
be derived from the union set of demographic information. 

If the information in the union set of demographic information is incomplete for 

10 some reason, the summary demographic parameters can be modeled or estimated based 
upon predefined rules using the union set of data. Alternatively, or in addition, the 
summary demographic parameters can be estimated based upon extrapolations or 
interpolations from demographic data associated with neighboring street addresses, 
households in similar housing or living on comparable parcels of land. 

15 To protect the identity of the individual residents within the predefined 

geographic region, the demographic data for each street address, household, parcel of 
land or other identifier is rolled together with at least one, but preferably at least two 
other street addresses, household, parcel of land or identifier. This creates a number of 
aggregated, summary data records, one for each group or set of adjacent street addresses, 

20 households, parcels of land or other identifiers. A number of summary demographic 
variables are produced for each aggregated grouping. Again, if the information in the 
aggregated grouping is incomplete, the summary demographic variables can be modeled 
or estimated, similar to that described above. 

An end user of the demographic data is preferably only given access to or able to 

25 generate queries from the aggregated summary data records and/or the corresponding 
summaries, but not the demographic data for each street address, household, parcel of 
land or other identifier. 

For each aggregated grouping, profile variables are produced for mapping or 
analysis using standard Geographic Information System (GIS) software or custom 

30 software applications. Similar to the format of a U.S. Census data file, aggregated 

information is provided as summary counts that can be used in tables, maps or charts or 
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combined with other aggregated groupings to form larger, user-defined study areas. Data 
variables may include, but are not limited to, household and population counts, resident 
and householder ages, size and composition of households, length of time at current 
address, vehicle ownership, type of dwelling, and value of dwelling. Because of the 
small geographic clusters, unique types of maps and forecast models can be produced to 
showing demographic patterns, concentrations and trends. 

Brief Description of the Drawings 
Figure la - a high level schematic diagram of an illustrative embodiment of the present 
invention; 

Figure lb - sample layout for school census input data file including student and 
preschool records with associated child and parent/guardian descriptors; 
Figure lc - sample layout for property tax data file including ownership, sales and 
dwelling data by parcel; 

Figure Id - sample layout for a drivers license database containing driver attributes, 
home address and issuing dates; 

Figure le - sample layout for a vehicle registration data file including vehicle and 
owner attribute data along with resident address; 

Figure If - sample layout for water utility billing database identifying current and 
previous occupants, as well as service connect/disconnect dates; 
Figure 2 - flowchart showing an illustrative method for assembling the geo- 
demographic cluster area datasets (See #30 of Figure la); 

Figures 3a-3h - sample layout of a household-level demographic data file produced for 
each household; 

Figure 4 - GIS map of a predefined geographic region having selected demographic 
data overlaid thereon. 

Detailed Description of the Invention 
Figure la is a high level schematic diagram of an illustrative embodiment of the 
present invention. A number of source databases are shown at 12, 14, 16, 18, 20, 22 and 
24, each selected to provide at least some resident attribute data that is different from the 
data provided by the other source databases. Also, the source databases 12, 14, 16, 18, 
20, 22 and 24 preferably relate to a predefined geographic region, such as a school 



enrollment area, a housing renewal area, a transit corridor, a neighborhood, a city, a town, 
a county, a planning district, a service area of an organization or business, or any other 
predefined geographic region. 

In the illustrative embodiment, source database 12 is a school database that 
5 identifies children's names, ages, street addresses, etc. Source database 12 may help 
identify the children living at each of the street addresses, households, parcels of land, 
etc. within the predefined geographic region. Figure lb is a sample layout for school 
census database 12 consisting of student and preschool records with associated child and 
parent/guardian descriptors . 

10 Source database 14 is a postal service database that identifies street addresses in 

the predefined geographic region. The postal service database may help provide a 
baseline for a master address file, as further described below. 

Source database 16 is a property tax database that identifies the owner's name, the 
type of dwelling, the value of the property, etc., for each residential parcel of land in the 

15 predefined geographic region. Figure lc is a sample layout for a property tax database 16 
having a number of input fields for parcel of land. 

Source database 18 is a drivers license database that may identify the street 
address, age, gender, etc., for each driver in the predefined geographic region. Figure Id 
is a chart showing illustrative input fields for a drivers license database 1 8 having a 

20 number of input fields for each driver. 

Source database 20 is a motor vehicle registration database that identifies the 
owner's name, street address, registration or renewal date, type of vehicle, etc., for each 
registered vehicle in the predefined geographic region. Figure If is a chart showing 
illustrative input fields for a motor vehicle registration database 20 having a number of 

25 input fields for each motor vehicle. 

Source database 22 is a water utility billing database that identifies street 
addresses, current and former occupant names, service connect and disconnect dates, 
etc., within the predefined geographic region. Figure le is a chart showing illustrative 
input fields for a utility database 22 having a number of input fields for each street 

30 address or parcel of land. 
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Many of the illustrative source databases 12, 14, 16, 18, 20, 22 and 24 are 
regularly updated by the agency or organization responsible for maintaining the database. 
Therefore, each of the source databases shown may provide relatively up-to-date 
information for use by the present invention. No single agency database is sufficiently 
5 accurate or complete for demographic profiling purposes in and of itself. In combination, 
using the methods and processes associated with this invention, these databases become a 
significant resource for producing current and accurate demographic profiles. 

It is contemplated that the resident attribute data contained in the above source 
databases, and others, may be linked, combined, and synthesized to create 
10 demographic profiles of households in the predefined geographic region. These 
profiles may include many demographic variables including, for example, total 
% population, age distribution, race/ethnicity distribution, age of head of households, 

f\ household size and composition (adults, children, seniors), attributes of children in school 

£i (school, grade, limited English proficiency status, standardized test scores, free and 

f% s 15 reduced-price lunch participation, etc.), types of dwellings, property values, owner or 
*M renters, affordability of owner-occupied homes, home sale date and price , turnover rate 

Cj for both owner-occupied and rental property, length of time at current address, age of 

'% housing, and vehicle ownership. 

111 Some examples of other databases 24 include, for example, Dun and Bradstreet 

Q. 20 employer data, employee and employer data available from some states' Departments of 
Economic Security, library cardholder data, voter registration data, crime statistics data, 
etc. Using such databases, a number of additional demographic variables can be 
generated including, for example, employment status, household wage income, place of 
employment (which may be useful in identifying commuting patterns among other 
25 things), births, deaths, public assistance usage and crime descriptors (location, type of 
offense , etc.). 

The demographic or other data from each of the source databases, such as source 
databases 12, 14, 16, 18, 20, 22 and 24, is linked together by a corresponding street 
address and/or property identifier within the predefined geographic region. In Figure la, 
30 the data from each source database 12, 14, 16, 18, 20, 22 and 24 is associated with a 
corresponding household within the predefined geographic region. This is preferably 
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accomplished by relating the address information in each of the source databases 12, 14 ? 
16, 18, 20, and 22 to a particular household within the predefined geographic region. 

Once the data in the various source databases 12, 14, 16, 18, 20, 22, and 24 is 
associated with a particular household, all records from all of the source databases are 
5 combined into a new resident- specific dataset grouped by common address, shown at 26. 
Each address and each current and former resident of an address may be represented by 
records from many source databases. A processing routine selects and tags pertinent 
records for each address in the combined resident-specific dataset and produces a 
tentative demographic profile for each street address, household, parcel of land, or other 

10 identifier. This tentative demographic profile separates current from former residents, 
and determines the head of household. 

Once the pertinent demographic attributes for each resident have been identified 
and tagged in the resident-specific dataset, the records are collapsed and the demographic 
variables are summarized at the household level. The result is a new dataset, the 

15 household-specific dataset, shown at 28. 

To protect the identity of the individual residents or households within a 
predefined geographic region, the demographic data for each household is preferably 
rolled together with at least one, but preferably two other households, and more 
preferably three to four neighboring households. This creates a number of geo- 

20 demographic cluster data sets, shown generally at 30. In a preferred embodiment, a 
number of summary demographic variables are created for each geo-demographic cluster 
data set. 

Each demographic cluster data set is preferably, though not necessarily, created 
from demographic data from households on contiguous parcels. A contiguous parcel 

25 includes a common border with another parcel. The demographic data for households of 
non-contiguous parcels may also be used to form a demographic cluster data set. A 
demographic cluster data set may be created by associating demographic data from 
households on adjacent or proximate parcels or households having common attributes 
such as having a house of a certain age, being on a lakeshore, near a busy intersection or 

30 other physical, geographic or common feature or characteristic. One such characteristic 
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may be that the households are proximate the edge or boundary of the predefined 
geographic region. 

A user 32 of the demographic data is preferably only given access or able to 
generate queries from the geo-demographic cluster data sets 30 and/or the corresponding 
5 summaries, but not the demographic data at the individual household dataset 28 level 
This is illustrated by wall 38 disposed between user 32 and household dataset 28 in 
Figure la. User 32 may include, for example, civic organizations, faith communities, 
community partnerships, city or country agencies, school districts, nonprofit service 
providers, advocacy groups, community development groups, foundations, charities, 
10 businesses, or any other individual or organization, as desired. 
% In a preferred embodiment, the user 32 may use the geo-demographic cluster data 

ft! sets 30 for various past or forward thinking purposes. Examples of uses for the geo- 

jg demographic cluster data sets 30 include neighborhood improvement and lobbying 

jf efforts, grassroots community organizing, geographic targeting of services or funds, 

£i 15 allocating grants and program funding, needs assessment, preparing grant proposals, 
promoting public awareness, media relations, organizational budget planning, calling 
II together a collaborative effort, site selection for programs, services or businesses, 

J] scanning for early signs of neighborhood decline or improvement, locating specific 

*f opportunities to add affordable housing, etc. 

20 Figure 2 is a flow chart showing an illustrative method for assembling the geo- 

demographic cluster dataset 30 of Figure la. The method begins at step 50, wherein a 
number of source databases are acquired, such as source databases 12, 14, 16, 18, 20, and 
22. The source databases may be acquired from various organizations including, for 
example, local, state, and federal government agencies, utility companies, schools and 
25 school districts, commercial organizations or entities such as Dun & Bradstreet, LEXIS- 
NEXUS, Dialog, etc. Examples of government agencies that may provide source 
databases include the United States Postal Service, the department of motor vehicles, the 
property tax assessors office, the department of health, the city water works, the police 
department, the FBI, the department of transportation, the department of economic 
30 security, and others. 
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Since the source databases may be received from multiple sources, each source 
database may have to be cleaned, standardized, and/or formatted before use. This is 
shown at step 52. This is preferably accomplished using one or more data-cleaning 
programs that identify the relevant data within each raw source database, and output a 
5 number of records that are in a desired format. The data-cleaning programs may also 
initially access the quality and compatibility of the data and identify potential data- 
scrubbing tasks. For example, the data-cleaning programs may identify and parse 
multiple names for a particular record (e.g., John and Jane Doe). The data-cleaning 
programs may also do a rough cleaning of the raw source databases, such as name 

10 formatting, address parsing, date formatting, etc., as well as putting this data into a 
predefined database format, and adding a unique database key that identifies the source 
database and record. Preferably the addresses are placed into a standardized format using 
Centrus Desktop Software, commercially available from Sagent Technologies, Inc., 
Clearwater, Florida. Preferably, the source database records are placed in a file that is 

15 compatible with a database program, such as Microsoft Access, Microsoft SQL server, 
Oracle8i, etc. 

Next, and as shown at 54, a master street address file is created. To accomplish 
this, an initial address file is preferably extracted from residential addresses in the 
property tax database 16. Then, any new (unmatched) addresses from the postal service 

20 database 14 are added. Then, any new (unmatched) addresses from the utility database 
22 are added. Once this is completed, a first round of quality checks is performed. For 
example, the address counts for multifamily properties are preferably compared to known 
unit counts. Duplex and triplex properties are preferably checked to ensure that each unit 
has an individual address, and duplicate addresses are eliminated. 

25 Another round of quality checks may also be performed, as shown at 56. During 

this round of quality checks, address information that is discrepant among the different 
source databases is reconciled. The basic household counts represented by the master 
street address file are cross-checked against digital property and land use maps, 
ownership data files, and/or other local sources of household counts (e.g., local planning 

30 agencies). This check ensures an accurate base from which to build household 
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demographic profiles. Some hand checking may also be performed, resulting in a 
cleaned and corrected master street address file. 

Once the master street address file is created, a unique address key may be 
assigned to each address in the predefined geographic region. Then, the data for each 
5 source database 12, 14, 16, 18, 20, 22 and 24 is associated with a corresponding street 
address or address key, as shown at 58, This is preferably accomplished by relating the 
address field in each of the source databases 12, 14, 16, 18, 20, 22 and 24 to a particular 
street address in the master address file. 

Once this is complete, any source data that is not associated with an address is 

10 reviewed and assigned to an appropriate address, if possible. The number of matches 
between the addresses in each source database 12, 14, 16, 18, 20, 22 and 24 and the 
master address file may be maintained, and subsequently compared against the total 
number of data entries or listings in the corresponding source database. This can be used 
to determine the extent of non-matches in each source database. Also, the number of 

15 matches for each address in the master address file may be maintained to identify those 
addresses that have a low match rate. Any variations can be investigated and corrected, if 
desired. 

Once the data in the various source databases 12, 14, 16, 18, 20, 22 and 24 is 
associated with a particular street address, and the above quality checks are complete, all 
20 records from all of the source databases are combined into a new resident-specific dataset 
grouped by common address, as shown at 60. Each address and each current and former 
resident of an address may be represented by records from many source databases. 

A processing routine then traverses the resident-specific dataset and identifies 
unique persons, evaluates name forms to determine family groupings, and evaluates 
25 transaction dates (e.g., license renewal date, etc.) to separate current from former 

residents. The routine selects and tags pertinent records for each address in the combined 
resident-specific dataset and produces a tentative demographic profile for each street 
address, household, parcel of land, or other identifier. This process is shown at 62. 

Next, a head of household may be determined for each address, as shown at 64. 
30 This is preferably accomplished by examining the data entries and/or transaction dates 
associated with each address. If there is a property ownership record, the first person 
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listed in this record may be considered the head of household. Alternatively, or in 
addition to, if there is no property ownership record, the oldest current resident may be 
considered the head of household. Where enough data exists to do so, one head of 
household is tagged for each household grouping of records in the resident-specific 
5 dataset. If the information in the resident-specific dataset is deemed incomplete for some 
reason, the demographic variables can be modeled or estimated based upon-predefined 
rules. For example, if the age of a parent is unknown but the age of the children are 
known, one rule may be "add 25 years to the oldest child's age to yield the age of the 
parent". 

10 In a more detailed example, the age of a head of household is modeled. A check 

is first made to determine if the household has a spouse and if the age of the spouse is 
known. If so, then the age of the spouse is used as a proxy for the age of the head of 
household. If not, a check is made to determine if the household includes one or more 
children. If the household does include one or more children, and the age of the children 

15 are known, then the age of the head of household is computed as 25 years plus the age of 
the eldest child. If the household does not include children, then the age of the head of 
household is extrapolated or interpolated from the ages of the heads of households of 
nearby or neighboring households. 

Alternatively, or in addition, the missing demographic parameters can be 

20 estimated based upon extrapolations or interpolations from demographic data associated 
with neighboring households. 

Next, and as shown at 66, household profiles may be created. Individual records 
in the resident-specific dataset may be collapsed into one profile record for each 
household. Then, a number of summary demographic parameters may be generated for 

25 each household or street address, as shown at 68. For example, the number of people, 
including children, in each household may be derived from the household profile records. 
Alternatively, or in addition, the summary demographic parameters may be created 
directly from the resident-specific dataset. Figures 3 A-3H show a sample layout of a 
household profile record. Again, if the information in the household profile datasets is 

30 incomplete, the summary demographic variables shown in Figures 3A-3H can be 
modeled or otherwise estimated in a manner similar to that described above. 
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To protect the identity of the individual residents or households within a 
predefined geographic region, the demographic data for each household profile and/or 
household profile summary is preferably rolled together with at least one other 
household, but more preferably two and yet more preferably three to four neighboring 
5 households. This creates a number of geo-demographic cluster areas, shown generally at 
70. The maximum number of households in a geo-demographic cluster area can be 
selected to provide the desired level of precision needed for a study or analysis, but will 
often be preferably less than one hundred households, more preferably less than twenty- 
five households, still more preferably less than ten households and most preferably less 

10 than four households. 

In one embodiment, each set of three to five neighboring households are manually 
selected using a GIS map of the predefined geographic area. The map may be shown on 
a computer display using Arc View GIS software or the like. It is contemplated that this 
may be automated, if desired. A number of checks may then be performed, such as 

15 ensuring that none of the selected sets of households cross political or planning 
boundaries, that minimum criteria for data summary and data privacy standards are met, 
etc. Once checked, a new base map layer may be created for the Arc View GIS software 
that displays a boundary around each of the sets of households on the map of the 
predefined geographic region. Each set of households corresponds to one of the geo- 

20 demographic cluster areas, as described above. 

In a preferred embodiment, a number of summary demographic variables are 
generated for each geo-demographic cluster area dataset This is preferably 
accomplished by collapsing the summary demographic variables established for each 
household into a corresponding summary record for each set of households. One such 

25 summary record is shown in the Appendix. Each of the fields listed in the Appendix are 
either extracted directly from the household profile data sets or from the corresponding 
summaries thereof. A user of the demographic data is preferably only given access to or 
able to generate queries from the geo-demographic cluster area data sets but not the 
demographic data at the individual household level. 

30 It should be understood that the steps in the above processes may be performed in 

an order different from the above listed order, and that some steps may be added and/or 
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omitted without deviating from the spirit or scope of the invention. It is anticipated that 
in some applications, two or more steps may be performed more or less simultaneously to 
promote efficiency. 

The various demographic variables in each geo-demographic cluster area dataset 
5 may be displayed on a map, if desired. One illustrative map is shown in Figure 4. Figure 
4 shows a GIS map of a predefined geographic region, which is outlined by an outer 
boundary 100. Also shown are a number of local boundaries, each extending around a 
corresponding set of households. Two such local boundaries are shown at 102 and 104. 
Each local boundary 102 and 104 preferably corresponds to one or more of the geo- 
10 demographic cluster area datasets described above. 

Some of the demographic parameters generated by the present invention may 
Jji represent a certain percentage of a whole. For example, a set of parameters of a geo- 

demographic cluster area dataset or a summary thereof may correspond to a percentage of 
45 the households with in the geo-demographic cluster area that have a head of household 

S 15 within a certain age range. For example, a first parameter may specify the percentage of 
% t head of households that are under 25 years of age. Another related parameter may 

Q specify the percentage of head of households that are between 25 and 34 years of age, as 

S* so on. A last parameter may specify the percentage of head of households that are greater 

|j than 75 years of age, thus accounting for all possible ages. These parameters are 

20 generally shown at 1 1 0 of Figure 4, 

To display this information, a pie chart may be displayed over each set of street 
addresses, households, parcels of land or other identifiers represented by a geo- 
demographic cluster area data set. For example, the set of households outlined by 
boundary 102 has a pie chart 112. Each pie chart preferably has a pie section that 
25 corresponds to each of the related parameters, and each pie section is preferably sized to 
correspond to the percentage that the corresponding parameter represents relative to the 
whole. An average of the related parameters may also be displayed adjacent each pie 
chart, as shown at 1 14. 

While Figure 4 is directed at displaying the age distribution of the head of 
30 households, other parameters can be likewise displayed. For example, pie charts may be 
used to display the distribution of year of sale for residential properties over the past 10 
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years, income distribution, ethnicity distribution, distribution of adult households with no 
children, adult households with children at home, and senior citizen households, 
distribution of owner-occupied turnover, distribution of workforce concentrations, 
distribution of building age, distribution of building size, distribution of property values, 
distribution of owner/renter occupancy, etc. 

Having thus described the preferred embodiments of the present invention, those 
of skill in the art will readily appreciate that the teachings found herein may be applied to 
yet other embodiments within the scope of the claims hereto attached. 
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